Skip to main content

Group-based trajectory models of integrated vaccine delivery and equity in low- and middle-income countries

Abstract

Background

Integrated vaccine delivery – the linkage of routine vaccination with provision of other essential health services – is a hallmark of robust primary care systems that has been linked to equitable improvements in population health outcomes.

Methods

We gathered longitudinal data relating to routine immunization coverage and vaccination equity in 78 low- and middle-income countries that have ever received support from Gavi, the Vaccine Alliance, using multiple imputation to handle missing values. We then estimated several group-based trajectory models to describe the relationship between integrated vaccine delivery and vaccination equity in these countries. Finally, we used multinomial logistic regression to identify predictors of group membership.

Results

We identified five distinct trajectories of geographic vaccination equity across both the imputed and non-imputed datasets, along with two and four trajectories of socioeconomic vaccination equity in the imputed and non-imputed datasets, respectively. Integration was associated with reductions in the slope index of inequality of measles vaccination in the countries analyzed. Integration was also associated with an increase in the percentage of districts reporting high measles vaccination coverage.

Conclusions

Integrated vaccine delivery is most strongly associated with improvements in vaccination equity in settings with high baseline levels of inequity. Continued scholarship is needed to further characterize the relationship between integration and health equity, as well as to improve measurement of vaccination coverage and integration.

Background

Health systems research features a longstanding debate over the merits of vertical versus horizontal modes of health service delivery. Broadly, vertical programs are disease-specific, often freestanding initiatives with specified objectives to be achieved within a limited timeframe [1]. The Global Polio Eradication Initiative – a USD$20 billion program that has eliminated poliomyelitis incidence by 99.9% since its inception in 1988 – is a classic example of a vertical health program, as was the recent global COVID-19 vaccination effort [2]. By contrast, the World Health Organization (WHO) defines horizontal (i.e., “integrated”) approaches as “the process of bringing together common functions within and between organizations to solve common problems, developing a commitment to shared vision and goals and using common technologies and resources to achieve these goals” [3]. Systems for delivering comprehensive primary health care – including all preventive, curative, palliative, and rehabilitative services needed over a person’s lifetime – embody the ethos of integrated health service provision, which aims to “meet people’s health needs throughout their lives” [4].

The prevalence of vertical programs in resource-constrained settings raises questions about conditions under which it is appropriate to transition a given vertical program into an integrated, horizontal system – and, if appropriate, how best to facilitate this transition. A robust body of literature affirms the value of pursuing integrated approaches to delivering many routine health services, citing improvements in health system governance, program sustainability, community involvement, equitable provision of care, and access to and coverage of essential services [5,6,7,8,9]. Other studies, however, paint a murkier picture: several systematic reviews, for example, assert that the purported benefits of integration are highly variable across contexts or remain largely unproven in public health and healthcare practice, citing logistical challenges and unequal resource allocation as barriers to achieving desired levels of coverage [10,11,12,13]. Furthermore, some studies note that integration may risk undermining existing health services, including immunization, and that the dearth of quality evidence on the benefits and drawbacks of integration makes it difficult to accurately assess its true impacts [11, 14, 15].

Though integrated delivery may not be appropriate for every health service, integrating routine vaccinations with other core health services may yield positive benefits for population health. Because immunization coverage is relatively high in many countries, vaccination programs are an attractive vehicle for concomitantly increasing coverage of other critical health services. For this reason, WHO’s Immunization Agenda 2030 (IA2030) explicitly emphasizes the importance of “building a strong national immunization infrastructure integrated into primary health care services, as a way to both achieve and sustain elimination and eradication goals,” as well as to ensure that all people benefit from immunization throughout the life-course [16]. For the purposes of this investigation, we extrapolate from this description to define integrated vaccine delivery as the linkage of routine vaccination services with other core public health interventions within a primary healthcare system (versus standalone vertical programs), in alignment with Gavi’s description of integrated delivery [17].

Some evidence suggests that linking immunization with other public health interventions and core health services (e.g., deworming, Vitamin A supplementation, bednet distribution) could reduce vaccination inequities in low- and middle-income countries (LMICs) [14, 18,19,20,21]. For this reason, countries receiving financial and programmatic support from Gavi, the Vaccine Alliance (“Gavi”) have implemented strategies aimed at both improving health equity and strengthening health systems [22]. WHO further notes that “integrated health services by design enhance equity; they encourage the selection of services based on the holistic needs of a given population and deliver many different types of care across the life course, from health protection and promotion and disease prevention to diagnosis, treatment, disease management, long-term care, rehabilitation and palliative care” [23].

Despite the documented benefits and drawbacks of integrated vaccine delivery, its relationship with vaccination equity has not, to our knowledge, been systematically studied across LMICs. Moreover, we have not identified any studies measuring the longitudinal impacts of integrated vaccine delivery on vaccination equity at the country level. Here, we examine the relationship between integrated vaccine delivery and vaccination equity in low- and middle-income countries by using longitudinal data to develop several group-based trajectory models.

Methods

Measuring integrated vaccine delivery & vaccination equity

First, we purposively examined the peer-reviewed and grey literature for existing measures of vaccination equity and integration. We found that studies of vaccination distribution and uptake in LMICs generally frame equity in terms of crude coverage within and across key dimensions of vulnerability, including but not limited to age, sex or gender, race, wealth level, education level, citizenship status, and geography (i.e., urban vs. rural setting) [24,25,26,27,28,29]. Crude coverage refers to the proportion of individuals within a population targeted for vaccination that actually receives said vaccination (by contrast with effective coverage, which describes the proportion of a target population that receives a given vaccination and subsequently undergoes seroconversion, thereby developing protective immunity) [30].

The crude coverage-based approach to measuring vaccination equity has been embraced by many public health practitioners, donors, and decision-makers, including Gavi. As part of its 2016-2020 strategy to support equitable immunization programs in lower-income countries, Gavi published a set of accompanying indicators to monitor progress toward its stated vaccine, systems, sustainability, and market-shaping goals.[17] Two equity measures described in the strategy include equity of vaccination coverage by geography (i.e., the proportion of districts with coverage of the third dose of diphtheria-pertussis-tetanus-containing vaccine [DTP3] ≥80%, across all Gavi countries, hereinafter referred to as “geographic equity”) and equity of coverage by poverty status (i.e., the difference in coverage of the third dose of pentavalent vaccine between the richest and poorest quintiles, hereinafter referred to as “socioeconomic equity”) [17].

Arsenault et al. note that measuring absolute and relative coverage gaps between the wealthiest and poorest quintiles – the difference in coverage and the ratio of coverage, respectively – is an intuitive approach to quantifying vaccination equity when only two subgroups of analysis are under consideration (e.g., urban vs. rural, male vs. female) [31]. However, applying this approach to poverty status could conceal important coverage disparities within and between mid-range wealth quintiles [31].

For this reason, we modified Gavi’s measures of geographic and socioeconomic equity to examine, respectively, the proportion of districts within a given country to achieve ≥80% crude coverage of the first dose of measles-containing vaccine (MCV1) and the slope index of inequality (SII) of measles vaccination. WHO defines SII as “a complex, weighted measure of inequality that represents the absolute difference in estimated values of a health indicator between the most-advantaged and most disadvantaged (or vice versa for adverse health outcome indicators), while taking into consideration all the other subgroups” [32]. In this analysis, we calculated SII from estimates of MCV1 coverage disaggregated by wealth quintile. Larger, positive SII values indicate that high MCV1 coverage is more prevalent among wealthier quintiles, while smaller, negative values reflect greater coverage in poorer quintiles. This measure enables consideration of MCV1 coverage in mid-range wealth quintiles that would otherwise be excluded by using the absolute difference in coverage or the ratio of coverage.

We chose to frame equity in terms of MCV1 rather than DTP3 or pentavalent vaccination coverage for several reasons. First, DTP doses are administered almost exclusively through routine health programs, whereas measles vaccinations are delivered through both horizontal and vertical pathways, even in settings with high coverage [33]. Thus, considering MCV1 coverage enables us to discern whether equitable coverage varies by modality of vaccine delivery. Second, in many countries, the first three doses of DTP vaccines are typically administered at two, four, and six months of life, respectively (or at 6 weeks, 10 weeks, and 14 weeks of life if using the pentavalent vaccine) [34, 35]. MCV1, however, is not administered until at least 9 months of life to prevent maternal antibody interference with the live vaccine and subsequent vaccination failure [36]. Due to patient attrition often observed between DTP3 and MCV1 administration in resource-constrained settings, achieving and sustaining high MCV1 coverage thus represents a stretch goal for health systems in LMICs [37, 38]. Finally, measles outbreaks function as proverbial “canaries in a coalmine,” signaling poor health system functioning, persistent inequities in coverage, and challenges in immunization program implementation [37, 39,40,41,42]. Measles is also among the most contagious diseases, infecting and killing tens of thousands of children each year and leaving survivors with permanently weakened immune systems [43, 44]. Thus, we felt that framing our measures in terms of MCV1 coverage would serve as more meaningful indicators of vaccination equity in LMICs.

As part of its 2016-2020 strategy, Gavi utilized a measure of integrated vaccine delivery developed by WHO’s SAGE Decade of Vaccines Working Group (“the Working Group”). We chose to adopt this measure, which considers crude coverage of four core health services: DTP3, MCV1, protection at birth against neonatal tetanus (PAB), and at least one antenatal care visit (ANC1). If national co-coverage levels of these services are within ten percentage points of one another, and all four are greater than or equal to 70%, then the country in question is considered to have achieved integrated vaccine delivery. Per the Working Group, weak coverage correlation between these four services indicates poor integration, while the 70% threshold excludes weak health systems with poor service coverage across the board from being considered integrated [17]. This measure of integrated vaccine delivery is no longer a part of Gavi’s updated 2021-2025 strategy, but was in effect during the years in which our data was collected.

Data collection

From our purposive literature review, we identified several studies by Arsenault et al. that characterized country-level predictors of vaccination equity in countries supported by Gavi [31, 45, 46]. Drawing from these studies, we determined which variables to gather for our investigation. Next, we designed a collation tool in Google Forms, which we used to compile a dataset of these variables, which relate to routine health service coverage, socioeconomic conditions, and additional measures of health system performance for 78 countries that had ever received Gavi support, focusing on the years 2003-2019 (i.e., the period for which longitudinal routine immunization data from WHO were available). We excluded data from 2020 to avoid confounding effects on vaccine delivery due to the COVID-19 pandemic. We also excluded the years preceding 2008 in our geographic equity analysis due to unreliable district-level coverage estimates reported during those years. The complete dataset is available in Appendix A, and a glossary of collected indicators and their sources is available in Appendix B.

Group-based trajectory modeling

We applied group-based trajectory modeling (GBTM) to describe developmental trajectories of geographic and socioeconomic vaccination equity in Gavi countries between 2003 and 2019. GBTM was pioneered by Daniel S. Nagin and Kenneth C. Land, who first described the method in a landmark paper examining the relationships between age, rates of criminality, and differences between chronic and less-active criminal offenders [47]. GBTM has since been applied across a wide range of studies in psychology, sociology, criminology, and medicine [48,49,50,51]. GBTM is a method for approximating distinct developmental trajectories of an outcome of interest, drawing from longitudinal data. It has been described as a form of latent class modeling, wherein a set of observed variables are related to a set of latent variables (i.e., variables that are not directly observed, but inferred from observed variables) [52]. GBTM is a useful method for characterizing distinct longitudinal trends in a given outcome of interest, as well as for describing phenomena like vaccination equity that may not follow a predictable trajectory [53,54,55].

Using GBTM to explore integration and equity

As a form of latent class analysis, GBTM lends itself to analyzing the relationship between integrated vaccine delivery and equity for several reasons. First, observable variables – such as immunization coverage, wealth, and population – are often prone to measurement error and method variance, and latent variable methods can minimize potential systematic bias stemming from a single variable [56]. Second, given significant heterogeneity within countries and the fact that countries develop and achieve equitable health outcomes at differing rates, classifying them based solely on observable characteristics measured at the national level may not adequately explain longitudinal trends in equity. For example, though income level is strongly associated with vaccination equity in LMICs, some countries (e.g., Nigeria, a lower-middle-income country) nevertheless report significantly lower levels of MCV1 coverage across wealth quintiles compared to their peers (e.g., Zambia, another lower-middle-income country) and in some cases, even their poorer counterparts (e.g., Malawi, a low-income country) [57, 58]. Examining membership in unobserved classes could elucidate unexpected patterns in vaccination equity and help relate these patterns to observable variables [59].

Finally, both integration and equity manifest heterogeneously across countries. For example, infrastructural improvements may initially spark rapid increases in vaccination coverage, but these increases often plateau once coverage surpasses 80% [60]. Health service integration is also a highly dynamic phenomenon that may have varying effects on equity in different settings. Thus, given the possibility of diminishing equity returns in settings with already-high coverage and the heterogeneous effects associated with different forms of health service integration, grouping countries by their respective developmental equity trajectories may serve as a useful comparative device.

To the best of our knowledge, GBTM has not been previously applied in peer-reviewed health systems research focusing on vaccination, equity, or LMICs, though the method has been used to examine country-level phenomena such as infant mortality and terrorism [61, 62]. We posit that GBTM could help chart the developmental trajectories of health system performance over time, thereby elucidating how health outcomes of interest (e.g., equitable vaccination coverage) evolve longitudinally. It may also help identify correlates of equity and facilitate comparison between high- and low-performing groups.

Model specification, diagnostics, and data analysis

All data analysis was performed using Stata 17 [63]. We used traj, a Stata plugin developed by Bobby Jones and Daniel Nagin, to estimate several group-based trajectory models of geographic and socioeconomic vaccination equity across the 78 countries in our sample [64]. We also used siilin, a command developed by the International Center for Equity in Health, to estimate SII for countries with publicly available MCV1 coverage estimates disaggregated by wealth quintile [65]. Accompanying Stata code and output for each analysis is provided in Appendices C-F.

We first performed multivariate normal imputation to handle missing data in our sample, given a high degree of missingness in the variables required to measure integration (i.e., ANC1 and PAB), as well as those required to measure our equity outcomes (i.e., geographic equity, SII, and MCV1 coverage across each of the five wealth quintiles). We performed 10 imputations across these 9 variables for all 78 countries. This created an imputed dataset of 14,586 observations, of which 2,140 were ultimately used in the imputation regression model (see Table 1 for a summary of dropped observations). The analyses described hereinafter were conducted separately on both the imputed and non-imputed datasets. We chose to analyze both datasets to assess the extent to which our findings were sensitive to imputation.

Table 1 Observations omitted from the multiple imputation regression model

Next, we specified censored normal distribution models for each outcome of interest – geographic and socioeconomic vaccination equity – given that they are continuous measures with discrete minimum and maximum values. We then determined the optimal number of trajectory groups to include in each model: holding all other parameters constant, we estimated models with two, three, four, and five groups and found that a five-group model produced high Bayesian information criterion (BIC) and entropy values for the geographic equity model, while four-group and two-group specifications proved optimal for the non-imputed and imputed socioeconomic equity models, respectively. For comparison, Appendices C-F (containing our Stata output), also include diagnostics for the other models considered. Using procedures described by Soper, Cohen, and Westland, we estimated that a minimum of 1,599 observations would be required for the five-group geographic equity model to detect a small association (0.1) between integration and equity at 80% statistical power (p = 0.05), 150 observations to detect a medium association (0.3), and 38 observations to detect a large association (0.5). To achieve the same level of statistical power, the four-group socioeconomic equity model would require 1,454 observations to detect small associations, 137 observations to detect medium associations, and 34 observations to detect large associations [66,67,68]. The two-group socioeconomic equity model would require 947, 90, and 23 observations to detect small, medium, and large associations, respectively. Therefore, we concluded that the large number of observations across countries would sufficiently power our analysis to at least detect large associations over the study period.

To determine whether equity trajectories depend on integration in addition to time, we included integration as a time-varying covariate in all models. We then toggled the polynomial order of the imputed five-group geographic equity model and found that a linear specification for all groups produced high BIC and entropy values. A combination of intercept and linear polynomials produced a robust, non-imputed, four-group socioeconomic equity model, while linear polynomials alone proved sufficient in the imputed, two-group socioeconomic equity model. We used parametric bootstrap sampling to estimate group size confidence intervals. Next, we performed several diagnostic checks for each model: calculating average posterior probabilities of group assignment, determining the odds of correct group classification, and conducting a visual inspection of confidence intervals in resultant trajectory plots (Table 2) [69]. Finally, we performed multinomial logistic regression to identify predictors of group membership.

Table 2 Group-based trajectory model diagnostics

As it did not qualify as human subjects research, this investigation was deemed exempt from full review by the Institutional Review Board at the Johns Hopkins Bloomberg School of Public Health (FWA #00000287).

Results

Country characteristics

Our sample consisted of 78 countries that have ever received Gavi support. The majority of the countries in the sample reside in sub-Saharan Africa (n = 40, 51.3%), per the World Bank’s regional classification scheme, while 12 countries reside in East Asia and the Pacific (15.4%), 11 in Europe and Central Asia (14.1%), 6 in Latin America and the Caribbean (7.7%), 2 in the Middle East and North Africa (2.6%), and 7 in South Asia (9%). Additionally, the World Bank classifies 28 countries (35.9%) in the sample as low-income, 40 (51.3%) as lower-middle-income, and 10 (12.8%) as upper-middle-income. Across both the imputed and non-imputed datasets, mean geographic and socioeconomic equity were highest in Europe & Central Asia and lowest in sub-Saharan Africa. Furthermore, upper-middle-income countries reported the highest mean levels of equity across both datasets, while low-income countries reported the lowest mean levels. Complete demographic details for the countries, along with mean geographic and socioeconomic equity measures disaggregated by region and income level, are summarized in Table 3.

Table 3 Summary of country characteristics

Integrated vaccine delivery

Countries demonstrated varying levels of integrated vaccine delivery (hereinafter referred to as “integration,” as defined by the Gavi and the Working Group’s metric for integrated vaccine delivery) over the study period. Among low-income countries, 11 (out of 28 total, 39.3%) demonstrated integration of all four core services at various points between 2003 and 2019, compared to 20 (50%) lower-middle-income countries and 1 (10%) upper-middle-income country. Integrated vaccine delivery also varied geographically: 5 countries in East Asia and the Pacific (41.7% of all countries in the region), 3 (50%) countries in Latin America and the Caribbean, 5 (55.6%) countries in South Asia, and 19 (47.5%) countries in sub-Saharan Africa demonstrated integration at least once during the study period. By contrast, there were 46 countries that never demonstrated integration during the study period. Most of these countries reside in sub-Saharan Africa (n = 21), followed by Europe and Central Asia (n = 11), East Asia and the Pacific (n = 7), Latin America and the Caribbean (n = 3), the Middle East and North Africa (n = 2), and South Asia (n = 2). Table 4 summarizes integration scores earned by each country during the study period.

Table 4 Integrated vaccine delivery by country, 2003-2019

Trajectory analysis

Tables 5 and 6 present the maximum likelihood estimates for each model’s parameters, Tables 7 and 8 display the confidence intervals for each model’s equity estimates, Table 9 lists countries by group assignment, Tables 10 and 11 describe predictors of group membership, and Figures 1, 2, 3 and 4 illustrate the trajectories of geographic and socioeconomic equity over time. The geographic equity model produced five distinct trajectories across both the imputed and non-imputed datasets: a “low-increasing” curve (Group 1, blue) representing countries with relatively few districts with high MCV1 coverage across the study period; a “middle-decreasing” curve (Group 2, red) representing countries with middling proportions of districts with high MCV1 coverage; a “middle-stable” curve (Group 3, dark green) representing countries with fairly high and consistent proportions of districts with high MCV1 coverage; a “high-stable” curve (Group 4, orange) representing countries with the highest consistent proportions of districts with high MCV1 coverage; and a “middle-increasing” curve (Group 5, light green) representing countries with middling proportions of districts with high MCV1 coverage that gradually increased over the study period. In the non-imputed dataset, Groups 1-5 included roughly 13%, 18%, 27%, 30%, and 13% of the countries in our sample, respectively. The model based on the imputed dataset assigned 12%, 17%, 26%, 28%, and 16% of the countries to Groups 1-5, respectively.

Table 5 Maximum likelihood estimates: geographic equity
Table 6 Maximum likelihood estimates: socioeconomic equity
Table 7 Parametric bootstrap sampling confidence interval estimates: geographic equity
Table 8 Parametric Bootstrap sampling confidence interval estimates: socioeconomic equity
Table 9 Countries by Group Membership
Table 10 Predictors of group membership: geographic equity
Table 11 Predictors of group membership: socioeconomic equity
Fig. 1
figure 1

Geographic equity (non-imputed)

Fig. 2
figure 2

Socioeconomic equity (non-imputed)

Fig. 3
figure 3

Geographic equity (imputed)

Fig. 4
figure 4

Socioeconomic equity (imputed)

The non-imputed socioeconomic equity model produced four distinct trajectories: a “low-inequity” curve (Group 1, blue) representing countries with high MCV1 coverage among poorer wealth quintiles; a “medium-decreasing” curve (Group 2, red) representing countries with slightly lower MCV1 coverage levels among poorer quintiles; a “medium-stable” curve (Group 3, green) representing countries with consistently middling levels of MCV1 coverage among poorer quintiles; and a “high-inequity” curve (Group 4, orange) representing countries with very low MCV1 coverage among poorer quintiles. Groups 1-4 included roughly 39%, 30%, 27%, and 4% of the countries in our sample, respectively. By contrast, the imputed model produced two trajectories: a “low-stable” curve (Group 1, blue) consisting of 69% of countries in the sample, and a “high-stable” curve (Group 2, red) that included 31% of countries. The Group 1 curve represents countries with high levels of MCV1 coverage among poorer quintiles, while the Group 2 curve represents those with MCV1 coverage skewed toward wealthier quintiles.

We did not detect a statistically significant association between integrated vaccine delivery and geographic equity using the non-imputed dataset, or in Groups 1-3 in the non-imputed socioeconomic equity model. However, there was a significant association between the two in countries belonging to Group 4 (high-inequity) in the non-imputed socioeconomic equity model, both groups in the imputed socioeconomic equity model, and Groups 1-4 in the imputed geographic equity model. In the non-imputed dataset, integration was associated with a 0.53-unit reduction in SII in Group 4 (high-inequity). In Groups 1-4 in the imputed dataset, it was associated with 8.3-, 7.9-, 4.6-, and 1.6-percentage point increases per one-unit change in integration score, respectively, in the proportion of districts reporting greater than 80% MCV1 coverage. In this same dataset, integration was associated with a 0.054-unit reduction in SII in Group 1 (low-stable) countries and a 0.12-unit reduction in SII in Group 2 (high-stable) countries.

Predictors of group membership

Tables 10 and 11 summarize results from our multinomial logistic regression analyses, whereby we identified predictors of group membership for each trajectory model. In the non-imputed geographic equity dataset, we identified several predictors of membership in each group: in Group 2 (middle decreasing), income level, region, female education, political stability, corruption, out-of-pocket health expenditures, government expenditures on health, linguistic fractionalization, and distance (i.e., the proportion of the population more than 60 minutes by foot away from the nearest health facility); in Group 3 (middle-stable), income, region, political stability, government effectiveness, out-of-pocket health expenditures, government expenditures on health, external resources for health per capita, land area, and distance; in Group 4 (high-stable), income level, region, female education, government effectiveness, gender inequality, out-of-pocket health expenditures, government expenditures on health, external resources for health per capita, land area, linguistic fractionalization, and distance; and in Group 5 (middle-increasing), region, female education, political stability, gender inequality, land area, linguistic fractionalization, and distance. Notably, integration was not a significant predictor of membership in any of the five groups. Using the imputed dataset, however, we found that all of the variables included in the regression model were significant predictors of membership in Groups 1-4. Except for corruption, these variables were also significant predictors of Group 5 (middle-increasing) membership.

In the non-imputed socioeconomic equity dataset, we identified several significant predictors of Group 2 (medium-decreasing) membership, including female education, gender inequality, government expenditures on health, external resources for health per capita, and land area. Female education, gender inequality, out-of-pocket health expenditures, government health expenditures, external resources for health per capita, land area, linguistic fractionalization, and distance were also significant predictors of membership in Group 3 (medium-stable). Integration was not a significant predictor of membership in any group, nor did we identify any significant predictors of Group 4 (high-inequity) membership using the non-imputed dataset. Using the imputed dataset, however, we found that with the exception of geographic region, every variable in the model – including integration – was a significant predictor of Group 2 (high-stable) membership.

Discussion

In this investigation, we applied GBTM to examine the relationship between integrated vaccine delivery and vaccination equity in 78 LMICs that had ever received Gavi support. Using our non-imputed longitudinal dataset, we constructed models of geographic and socioeconomic equity consisting of five and four distinct equity trajectories (i.e., groups), respectively. Though integration was not a statistically significant predictor of group membership in either model, we identified several other important predictors (see Tables 10 and 11). Using our imputed dataset, we developed a second five-group geographic equity model, as well as a two-group socioeconomic equity model. With the exception of corruption, all of the variables included in the multinomial logistic regression – including integration – were significant predictors of group membership in the geographic equity model. Integration, along with all variables except geographic region, was also a significant predictor of membership in Group 2 (high-stable) of the imputed socioeconomic model.

The statistically significant association between integration and Groups 1-4 in the imputed geographic equity model carries important implications for public health policy and practice. This finding suggests that integrated vaccine delivery is most strongly associated with equity improvements in settings with chronically high levels of inequity (i.e., Group 1, low-increasing), followed by those reporting decreasing levels of equity over time (i.e., Group 2), and finally, in settings in which geographic equity has largely plateaued (i.e., Groups 3 and 4). However, it may have a weaker association with equitable vaccination coverage in settings like Group 5 (middle-increasing) countries, whose developmental trajectory commences at a middling level of equity and increases more rapidly than its counterparts in Groups 1-4. In the imputed model, integration was also a predictor of membership in all but the lowest-performing group (Group 1, low-increasing), further suggesting that integration is associated with high geographic equity achievement. Due to our small sample of countries, we were unable to ascertain whether integration might have had small- or medium-sized associations with geographic equity in groups in which we detected no statistically significant associations between the two. Nevertheless, given that measles risk is often spatially clustered, this finding may still be relevant for countries pursuing measles elimination as part of a national or multi-district mitigation or elimination strategy [70].

In the non-imputed model, integration showed a significant association with socioeconomic equity in Group 4 (high-inequity) countries: a 0.53-unit reduction in SII. In the imputed model, integration with associated with two additional statistically significant reductions in SII: a 0.054-unit drop in Group 1 (low-stable) and a 0.12-unit drop in Group 2 (high-stable). This suggests that integrated vaccine delivery may be most strongly associated with equity improvements in settings with high vaccination inequity at baseline. In this vein, we found that the relative risk of a country being assigned to Group 2 (high-inequity) would decrease by a factor of 0.49 if the country in question demonstrated integration (see Table 11). In settings with lower levels of socioeconomic inequity (i.e., Group 1 countries, low-inequity), integration may still have positive, albeit diminishing associations with equitable vaccination coverage.

Importantly, groups identified via GBTM are unobservable, latent constructs, and observed trajectories are not immutable. Rather, in this analysis, grouping is an aggregated strategy for summarizing trends in vaccination equity across highly heterogenous settings. As such, neither the groups nor their estimated trajectories can predict future equity outcomes in any single country. The number of resultant trajectories and their associated paths will likely evolve as data availability improves for outcome measures, and as additional years’ worth of data are incorporated, particularly with respect to socioeconomic equity. Though integration was not a significant predictor of membership in every group, our analyses do suggest an overall positive association between integrated vaccine delivery and both geographic and socioeconomic vaccination equity in LMICs that have ever received Gavi support. This finding resonates with calls to integrate standalone routine immunization programs into broader systems of care [60, 71,72,73].

Whether by reducing opportunities for missed vaccination or providing a “one-stop shop” for immunization and other essential health services, integrated vaccine delivery mechanisms may play important roles in shaping health equity [71]. Our finding that integration is most strongly associated with equity improvements in settings characterized by high baseline levels of geographic or socioeconomic inequity aligns with previous studies demonstrating that integrated health platforms can help resource-constrained settings achieve equitable health outcomes [14, 74,75,76]. Encouragingly, these findings also comport with health worker experiences delivering and patient experiences receiving integrated care. Reporting on focus groups held in four African countries, for example, Ryman et al. note that integration afforded patients greater convenience and access to needed services, reduced transportation times and costs, increased health service utilization and health worker efficiency, and reduced reporting requirements [77]. In this vein, our imputed dataset indicates that countries were likelier to belong to Group 2 (high-stable) if they reported a significant degree of linguistic fractionalization (RR: 2.27 [CI: 1.45, 3.56]), high levels of gender inequality (RR: 3.34 [CI: 1.92, 5.82]), or long distances to the nearest health facility (RR: 1.02 [CI: 1.02, 1.03]). Thus, demand-side interventions targeting these factors might play an important role in improving vaccination equity in LMICs.

This analysis does have several limitations, most of which relate to the quality and availability of our data. Our socioeconomic equity trajectories had wider confidence intervals and fluctuated over the study period, reflecting the paucity of vaccination coverage data disaggregated by wealth quintile. However, given that our results did not meaningfully vary between the imputed and non-imputed datasets, our finding that integration is associated with reductions in inequity likely still holds true.

Additionally, our measures of geographic equity and vaccination coverage were extracted from the WHO-UNICEF Joint Reporting Forms (JRF) on Immunization and WHO-UNICEF Estimates of National Immunization Coverage (WUENIC) at the global level. Previous studies suggest that while the accuracy and completeness of JRFs improves over time and with greater familiarity, critical immunization data are still often missing [78]. In some cases, data provided in response to JRF questions draw from in-country assessments of unknown quality and rigor [79]. WUENIC, in turn, are created from JRF estimates, national administrative coverage estimates (which may be biased by inaccurate numerators or denominators), survey estimates (e.g., Demographic and Health Surveys [DHS] and Multiple Indicator Cluster Surveys [MICS]), and other sources [80]. Furthermore, our measures of socioeconomic equity were calculated from DHS and MICS estimates of vaccination coverage by wealth quintile, which are available only for select years in a handful of countries. Policymakers and decision-makers in LMICs could thus support improved monitoring activities in LMICs by investing in stronger vaccination data collection capacities, systems, and workforces. Additionally, newer measures of equity – such as the Vaccine Economics Research for Sustainability and Equity composite vaccination equity assessment metric – offer more a more sophisticated approach to accounting for the structural factors underpinning observed disparities in coverage between wealth quintiles or other axes of vulnerability [81].

Despite the large number of observations per country and positive model diagnostics, our sample was relatively small, which prevented detection of small and medium associations between integration and equity, especially in our non-imputed dataset. This challenge has also been documented in other GBTM analyses examining country-level phenomena [62]. Loughran and Nagin do report that robust GBTM analyses are possible with as few as 500 study subjects when using Poisson-based models, but whether this threshold applies to other models (e.g., censored normal, binary logit) and the absolute minimum sample size required to apply GBTM remain unknown [82]. Further work is therefore needed to determine how best to model developmental trajectories in inherently small samples. Fortunately, our analysis was still able to capture diverging trends in group membership.

Another limitation relates to the measurement of integration itself. The Working Group’s measure is readily determined from publicly available data collected on a routine basis across all countries; thus, its primary value lies in its convenience and accessibility. Conceptually, however, it is a flawed metric because it does not account for the heterogeneity of integrated health service delivery and structural barriers that might impede a well-integrated system – for example, one with low but near-equal coverage across all services – from raising coverage. Therefore, this measure likely underestimates the number of countries to have demonstrated integration. Furthermore, health system integration may be understood as a continuum ranging from highly vertical programs (e.g., the Global Polio Eradication Initiative) to robust horizontal systems (e.g., those that provide comprehensive primary care) [1]. A quantitative measure of integration, therefore, should ideally exist on a continuous scale, unlike the Working Group’s dichotomous metric. A potential alternative (though, to our knowledge, one that is not publicly reported or readily computable) is the proportion of children under 5 who receive measles vaccinations via primary health programs versus vertical supplemental immunization activities, such as campaigns. Another option, albeit more complex, is to build a composite index that accounts for immunization program financing, workforce structure, modes of delivery, effective coverage, and barriers to vaccine access. Notably, the IA2030 Monitoring and Evaluating Framework includes integrated vaccine delivery as a strategic objective, but many of the prescribed country-level indicators are not routinely made public [83]. This framework does suggest using the composite coverage index (CCI) – a weighted average of eight preventive and curative interventions – but these values are currently only reported for select Countdown 2030 countries and are not reported longitudinally [16, 83]. Furthermore, because CCI is comprised of eight different indicators, we would have likely obtained a very small sample of countries with enough data to compute CCI, which would have further reduced the power of our study and our ability to detect associations between integration and equity.

Despite these limitations, findings from this analysis could nevertheless inform efforts to monitor integrated vaccine delivery in LMICs – an endeavor of particular significance as more LMICs transition away from Gavi support. Our findings could also support future studies of integration and vaccination equity. Follow-on qualitative case studies, for example, might compare and contrast processes of integration between countries in the low-increasing and high-stable geographic equity groups, identify barriers to integrated vaccine delivery among countries following a trajectory marked by high socioeconomic inequity, examine integration and equity trends at subnational levels in large heterogeneous countries, or consider potential demand-side interventions targeting mid-range wealth quintiles in the middle-increasing and -decreasing groups. These follow-on analyses, in turn, could inform decision-making and resource allocation to improve vaccination equity in LMICs. Further work is also needed to explore potential causal mechanisms underpinning the associations identified in this investigation, particularly in the context of universal health coverage provision. In this vein, future analyses might examine whether countries with integrated vaccine delivery programs are more likely to offer health packages or insurance schemes that subsidize the cost of vaccination, thereby incentivizing uptake increasing coverage.

Conclusion

Amid ongoing calls for universal health coverage and considering the persistent threat of vaccine-preventable diseases in resource-constrained settings, ensuring equitable vaccination remains an urgent public health imperative. The findings from this analysis – which applied GBTM to examine longitudinal trends in geographic and socioeconomic vaccination equity in 78 LMICs – suggest a positive association between integrated vaccine delivery and vaccination equity. Though continued scholarship is needed to further characterize the relationship between integration and health equity, this investigation constitutes a first step toward summarizing these complex phenomena at the country level.

Availability of data and materials

The datasets generated and/or analyzed in this study are available in the supplementary content of this paper.

Abbreviations

WHO:

World Health Organization

LMIC:

Low- and middle-income countries

Gavi:

Gavi, the Vaccine Alliance

DTP3:

Third dose of the diphtheria, tetanus, toxoid, and pertussis vaccine

MCV1:

First dose of measles-containing vaccine

SII:

Slope index of inequality

PAB:

Protection at birth against neonatal tetanus vaccine

ANC1:

Coverage of at least one antenatal care visit

GBTM:

Group-based trajectory modeling

BIC:

Bayesian information criterion

JRF:

WHO-UNICEF Joint Reporting Form

WUENIC:

WHO-UNICEF Estimates of National Immunization Coverage at the global level

DHS:

Demographic and Health Surveys

MICS:

Multiple Indicator Cluster Surveys

References

  1. Oliveira-Cruz V, Kurowski C, Mills A. Delivery of priority health services: searching for synergies within the vertical versus horizontal debate. J Int Dev. 2003;15:67–86.

    Article  Google Scholar 

  2. Razum O, Sridhar D, Jahn A, Zaidi S, Ooms G, Müller O. Polio: from eradication to systematic, sustained control. BMJ Glob Health. 2019;4. Available from: https://gh.bmj.com/content/4/4/e001633. [cited 2022 Feb 19].

  3. World Health Organization. Integration of health care delivery: report of a WHO study group. Geneva, Switzerland: World Health Organization; 1996. Report No.: 861. Available from: https://apps.who.int/iris/handle/10665/38408

  4. World Health Organization. Primary health care. World Health Organ. . Available from: https://www.who.int/health-topics/primary-health-care#tab=tab_1. [cited 2022 Feb 27].

  5. World Health Organization Maximizing Positive Synergies Collaborative Group, Samb B, Evans T, Dybul M, Atun R, Moatti JP, et al. An assessment of interactions between global health initiatives and country health systems. Lancet Lond Engl. 2009;373:2137–69.

    Article  Google Scholar 

  6. Wyss K, Doumagoum Moto D, Callewaert B. Constraints to scaling-up health related interventions: the case of Chad. Central Africa J Int Dev. 2003;15:87–100.

    Google Scholar 

  7. Seshadri SR. Constraints to scaling-up health programmes: a comparative study of two Indian states. J Int Dev. 2003;15:101–14.

    Article  Google Scholar 

  8. Munishi GK. Intervening to address constraints through health sector reforms in Tanzania: some gains and the unfinished business. J Int Dev. 2003;15:115–31.

    Article  Google Scholar 

  9. Atun R, de Jongh TE, Secci FV, Ohiri K, Adeyi O, Car J. Integration of priority population, health and nutrition interventions into health systems: systematic review. BMC Public Health. 2011;11:780.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Wallace A, Dietz V, Cairns KL. Integration of immunization services with other health interventions in the developing world: what works and why? Systematic literature review. Trop Med Int Health TM IH. 2009;14:11–9.

    Article  CAS  PubMed  Google Scholar 

  11. Wallace AS, Ryman TK, Dietz V. Experiences integrating delivery of maternal and child health services with childhood immunization programs: systematic review update. J Infect Dis. 2012;205(Suppl 1):S6-19.

    Article  PubMed  Google Scholar 

  12. Atun R, de Jongh T, Secci FV, Ohiri K, Adeyi O. Clearing the Global Health Fog: A Systematic Review of the Evidence on Integration of Health Systems and Targeted Interventions. Washington, D.C.: World Bank; Report No.: 166. Available from: https://openknowledge.worldbank.org/handle/10986/5946

  13. Atun R, de Jongh T, Secci F, Ohiri K, Adeyi O. A systematic review of the evidence on integration of targeted health interventions into health systems. Health Policy Plan. 2010;25:1–14.

    Article  PubMed  Google Scholar 

  14. Partapuri T, Steinglass R, Sequeira J. Integrated Delivery of Health Services During Outreach Visits: A Literature Review of Program Experience Through a Routine Immunization Lens | The Journal of Infectious Diseases | Oxford Academic. J Infect Dis. 2012 ;205. Available from: https://academic-oup-com.proxy1.library.jhu.edu/jid/article/205/suppl_1/S20/868074?login=true. [cited 2022 Feb 18].

  15. Montenegro H, Holder R, Ramagem C, Urrutia S, Fabrega R, Tasca R, et al. Combating health care fragmentation through integrated health service delivery networks in the Americas: lessons learned. J Integr Care. 2011;19:5–16.

    Article  Google Scholar 

  16. World Health Organization. Immunization Agenda 2030. World Health Organization; 2020. Available from: https://cdn.who.int/media/docs/default-source/immunization/strategy/ia2030/ia2030-draft-4-wha_b8850379-1fce-4847-bfd1-5d2c9d9e32f8.pdf?sfvrsn=5389656e_69&download=true. [cited 2023 Nov 26].

  17. Gavi, the Vaccine Alliance. 2016-2020 Strategy Indicator Definitions. Gavi, the Vaccine Alliance; 2016. Available from: https://www.gavi.org/sites/default/files/document/gavi-2016-2020-strategy-indicator-definitionspdf.pdf

  18. Guignard A, Praet N, Jusot V, Bakker M, Baril L. Introducing new vaccines in low- and middle-income countries: challenges and approaches. Expert Rev Vaccines. 2019;18:119–31.

    Article  CAS  PubMed  Google Scholar 

  19. Brearley L, Eggers R, Steinglass R, Vandelaer J. Applying an equity lens in the Decade of Vaccines. Vaccine. 2013;31(Suppl 2):B103-107.

    Article  PubMed  Google Scholar 

  20. Johri M, Verguet S, Morris SK, Sharma JK, Ram U, Gauvreau C, et al. Adding interventions to mass measles vaccinations in India. Bull World Health Organ. 2016;94:718.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Goodson JL, Kulkarni MA, Vanden Eng JL, Wannemuehler KA, Cotte AH, Desrochers RE, et al. Improved equity in measles vaccination from integrating insecticide-treated bednets in a vaccination campaign, Madagascar. Trop Med Int Health TM IH. 2012;17:430–7.

    Article  PubMed  Google Scholar 

  22. Dadari I, Higgins-Steele A, Sharkey A, Charlet D, Shahabuddin A, Nandy R, et al. Pro-equity immunization and health systems strengthening strategies in select Gavi-supported countries. Vaccine. 2021;39:2434–44.

    Article  PubMed  Google Scholar 

  23. Cash-Gibson L. Integrating Health Services. Geneva, Switzerland: World Health Organization; 2018. Available from: https://www.who.int/docs/default-source/primary-health-care-conference/linkages.pdf

  24. Mitchell S, Andersson N, Ansari NM, Omer K, Soberanis JL, Cockcroft A. Equity and vaccine uptake: a cross-sectional study of measles vaccination in Lasbela District. Pakistan BMC Int Health Hum Rights. 2009;9:S7.

    Article  PubMed  Google Scholar 

  25. Sundaram N, Voo TC, Tam CC. Adolescent HPV vaccination: empowerment, equity and ethics. Hum Vaccines Immunother. 2020;16:1835–40.

    Article  Google Scholar 

  26. Bishai D, Koenig M, Khan MA. Measles vaccination improves the equity of health outcomes: evidence from Bangladesh. Health Econ. 2003;12:415–9.

    Article  PubMed  Google Scholar 

  27. Geweniger A, Abbas KM. Childhood vaccination coverage and equity impact in Ethiopia by socioeconomic, geographic, maternal, and child characteristics. Vaccine. 2020;38:3627–38.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Helleringer S, Abdelwahab J, Vandenent M. Polio supplementary immunization activities and equity in access to vaccination: evidence from the demographic and health surveys. J Infect Dis. 2014;210(Suppl 1):S531-539.

    Article  PubMed  Google Scholar 

  29. Bhatia A, Mahmud A, Fuller A, Shin R, Rahman A, Shatil T, et al. The Rohingya in Cox’s Bazar: When the Stateless Seek Refuge. Health Hum Rights. 2018;20:105.

    PubMed  PubMed Central  Google Scholar 

  30. Colson KE, Zúñiga-Brenes P, Ríos-Zertuche D, Conde-Glez CJ, Gagnier MC, Palmisano E, et al. Comparative Estimates of Crude and Effective Coverage of Measles Immunization in Low-Resource Settings: Findings from Salud Mesoamérica 2015. PLOS ONE. 2015;10: e0130697.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Arsenault C, Harper S, Nandi A, Rodríguez JMM, Hansen PM, Johri M. An equity dashboard to monitor vaccination coverage. Bull World Health Organ. 2017;95:128.

    Article  PubMed  Google Scholar 

  32. World Health Organization. Health Equity Assessment Toolkit: Technical Notes. Geneva, Switzerland: World Health Organization; 2017. Available from: Health Equity Assessment Toolkit Built-in Database Edition Technical Notes

  33. Arambepola R, Yang Y, Hutchinson K, Mwansa FD, Doherty JA, Bwalya F, et al. Using geospatial models to map zero-dose children: factors associated with zero-dose vaccination status before and after a mass measles and rubella vaccination campaign in Southern province. Zambia BMJ Glob Health. 2021;6: e007479.

    Article  PubMed  Google Scholar 

  34. Immunization Action Coalition. DTaP, Tdap, and Td Catch-up Vaccination Recommendations by Prior Vaccine History and Age. 2020. Available from: https://www.immunize.org/catg.d/p2055.pdf. [cited 2022 Feb 27].

  35. World Health Organization. Diphtheria vaccine: WHO position paper – August 2017. Wkly Epidemiol Rec. 2017;31:417–36.

    Google Scholar 

  36. World Health Organization. Measles vaccines: WHO position paper – April 2017. Wkly Epidemiol Rec. 2017;17:205–27.

    Google Scholar 

  37. Hagan JE, Greiner A, Luvsansharav U-O, Lake J, Lee C, Pastore R, et al. Use of a Diagonal Approach to Health System Strengthening and Measles Elimination after a Large Nationwide Outbreak in Mongolia. Emerg Infect Dis. 2017;23:S77.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Mmanga K, Mwenyenkulu TE, Nkoka O, Ntenda PAM. Tracking immunization coverage, dropout and equity gaps among children ages 12–23 months in Malawi – bottleneck analysis of the Malawi Demographic and Health Survey. Int Health. 2021;ihab038.

  39. Orenstein WA, Hinman A, Nkowane B, Olive JM, Reingold A. Measles and Rubella Global Strategic Plan 2012–2020 midterm review. Vaccine. 2018;36(Suppl 1):A1-34.

    Article  PubMed  Google Scholar 

  40. Koh HK, Gellin BG. Measles as Metaphor-What Resurgence Means for the Future of Immunization. JAMA. 2020;323:914–5.

    Article  PubMed  Google Scholar 

  41. Measles and Rubella Initiative, American Red Cross, Centers for Disease Control and Prevention, UNICEF, United Nations Foundation, World Health Organization. Measles and Rubella Strategic Framework 2021-2030. Geneva, Switzerland: World Health Organization; Available from: https://apps.who.int/iris/bitstream/handle/10665/339801/9789240015616-eng.pdf?sequence=1

  42. Durrheim DN, Crowcroft NS, Strebel PM. Measles – The epidemiology of elimination. Vaccine. 2014;32:6880–3.

    Article  PubMed  Google Scholar 

  43. World Health Organization. Worldwide measles deaths climb 50% from 2016 to 2019 claiming over 207,500 lives in 2019. World Health Organ. 2020 [cited 2022 Feb 27]. Available from: https://www.who.int/news/item/12-11-2020-worldwide-measles-deaths-climb-50-from-2016-to-2019-claiming-over-207-500-lives-in-2019

  44. Guglielmi G. Measles erases immune ‘memory’ for other diseases. Nature. 2019 Oct 31; Available from: https://www.nature.com/articles/d41586-019-03324-7. [cited 2022 Feb 27].

  45. Arsenault C, Johri M, Nandi A, Mendoza Rodríguez JM, Hansen PM, Harper S. Country-level predictors of vaccination coverage and inequalities in Gavi-supported countries. Vaccine. 2017;35:2479–88.

    Article  PubMed  Google Scholar 

  46. Arsenault C, Harper S, Nandi A, Mendoza Rodríguez JM, Hansen PM, Johri M. Monitoring equity in vaccination coverage: A systematic analysis of demographic and health surveys from 45 Gavi-supported countries. Vaccine. 2017;35:951–9.

    Article  PubMed  Google Scholar 

  47. Age, criminal careers, and population heterogeneity: specification and estimation of a nonparametric, mixed Poisson model. Criminology. 1993;31:327–62.

  48. Nagin DS, Odgers CL. Group-based trajectory modeling in clinical research. Annu Rev Clin Psychol. 2010;6:109–38.

    Article  PubMed  Google Scholar 

  49. Nagin DS, Odgers CL. Group-based trajectory modeling in developmental science. Handb Dev Res Methods. New York, NY, US: The Guilford Press; 2012. p. 464–80.

  50. Nagin DS. Group-based Trajectory Modeling and Criminal Career Research. J Res Crime Delinquency. 2016;53:356–71.

    Article  Google Scholar 

  51. Proulx CM, Ermer AE, Kanter JB. Group-Based Trajectory Modeling of Marital Quality: A Critical Review. J Fam Theory Rev. 2017;9:307–27.

    Article  Google Scholar 

  52. Nguefack HLN, Pagé MG, Katz J, Choinière M, Vanasse A, Dorais M, et al. Trajectory Modelling Techniques Useful to Epidemiological Research: A Comparative Narrative Review of Approaches. Clin Epidemiol. 2020;12:1205.

    Article  Google Scholar 

  53. Dugan L, Yang S-M. Introducing Group-Based Trajectory Analysis and Series Hazard Modeling: Two Innovative Methods to Systematically Examine Terrorism Over Time. In: Lum C, Kennedy LW, editors. Evid-Based Counterterrorism Policy. New York, NY: Springer; 2012. p. 113–49. Available from: https://doi.org/10.1007/978-1-4614-0953-3_6. [cited 2023 Oct 16].

  54. Feldman B, Shen J, Chen C, Shi J, Xiang H. Perceived health after adult traumatic brain injury: a Group-Based Trajectory Modeling (GBTM) analysis. Brain Inj. 2020;34:741–50.

    Article  PubMed  Google Scholar 

  55. Ankuda CK, Ornstein KA, Kelley AS. Assessing Health Care Use Trajectories After the Onset of Functional Disability: Application of a Group-Based Trajectory Model. J Gerontol Ser B. 2022;77:S31-8.

    Article  Google Scholar 

  56. Latent Variable. Encycl Res Des. 2455 Teller Road, Thousand Oaks California 91320 United States: SAGE Publications, Inc.; 2010. Available from: http://methods.sagepub.com/reference/encyc-of-research-design/n213.xml. [cited 2022 Feb 27]

  57. Casey RM. Global Routine Vaccination Coverage, 2015. MMWR Morb Mortal Wkly Rep. 2016;65. Available from: https://www.cdc.gov/mmwr/volumes/65/wr/mm6545a5.htm. [cited 2022 Feb 27].

  58. The DHS Program. STATcompiler. Available from: https://www.statcompiler.com/en/. [cited 2022 Feb 20].

  59. Weller BE, Bowen NK, Faubert SJ. Latent Class Analysis: A Guide to Best Practice. J Black Psychol. 2020;46:287–311.

    Article  Google Scholar 

  60. Sodha SV, Dietz V. Strengthening routine immunization systems to improve global vaccination coverage. Br Med Bull. 2015;113:5–14.

    Article  CAS  PubMed  Google Scholar 

  61. Aktaş S, Finch SJ. Project MUSE - Group-Based Trajectory Modeling of Longitudinal International Infant Mortality Rates. Popul Rev. 2014;53. Available from: https://muse.jhu.edu/article/562362/pdf?casa_token=olSfKjRTJIYAAAAA:QuJgrumAecA3bjDHSvNb9bOI9G0yz6Lcdf-zYvfRdz6PvQNy2cX_W_MEP3IWt8xV8O9RN1FCu7k. [cited 2022 Feb 27].

  62. Morris NA, Slocum LA. Estimating Country-Level Terrorism Trends Using Group-Based Trajectory Analyses: Latent Class Growth Analysis and General Mixture Modeling. J Quant Criminol. 2012;28:103–39.

    Article  Google Scholar 

  63. Stata Statistical Software: Release 17. College Station, TX, USA: StataCorp; 2021.

  64. Jones BL, Nagin DS. A Stata Plugin for Estimating Group-Based Trajectory Models. 2012. Available from: https://ssrc.indiana.edu/doc/wimdocs/2013-03-29_nagin_trajectory_stata-plugin-info.pdf. [cited 2022 Feb 27]

  65. International Center for Equity in Health. Absolute and relative measures of inequality. Int. Cent. Equity Health Pelotas. Available from: https://equidade.org/siicix. [cited 2022 Feb 28].

  66. Soper D. Free A-priori Sample Size Calculator for Structural Equation Models. 2022. Available from: https://www.danielsoper.com/statcalc/calculator.aspx?id=89. [cited 2022 Feb 28]

  67. Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. New York, NY: Lawrence Erlbaum Associates; 1988. Available from: https://www.taylorfrancis.com/books/mono/https://doi.org/10.4324/9780203771587/statistical-power-analysis-behavioral-sciences-jacob-cohen. [cited 2022 Feb 28]

  68. Christopher Westland J. Lower bounds on sample size in structural equation modeling. Electron Commer Res Appl. 2010;9:476–87.

    Article  Google Scholar 

  69. Nagin DS. Group-Based Modeling of Development. 1st ed. Cambridge, MA, USA: Harvard University Press; 2005. Available from: https://www.hup.harvard.edu/catalog.php?isbn=9780674016866. [cited 2022 Feb 27]

  70. Brownwright TK, Dodson ZM, van Panhuis WG. Spatial clustering of measles vaccination coverage among children in sub-Saharan Africa. BMC Public Health. 2017;17:957.

    Article  PubMed  PubMed Central  Google Scholar 

  71. Mantel C, Cherian T. New immunization strategies: adapting to global challenges. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2020;63:25.

    Article  PubMed  Google Scholar 

  72. Mihigo R, Anya B, Okeibunor J, Ajibola S, Boakye-Agyemang C, Muzenda L, et al. African vaccination week as a vehicle for integrated health service delivery. BMC Health Serv Res. 2015;15:358.

    Article  PubMed  PubMed Central  Google Scholar 

  73. Ropero-Álvarez AM, Kurtis HJ, Danovaro-Holliday MC, Ruiz-Matus C, Tambini G. Vaccination Week in the Americas: an opportunity to integrate other health services with immunization. J Infect Dis. 2012;205(Suppl 1):S120-125.

    Article  PubMed  PubMed Central  Google Scholar 

  74. Lava JB, Claro V de, Quiñon MS, Labis R, Marcelo W, Lucero MA, et al. Integrating COVID-19 Vaccination in Primary Care Service Delivery: Insights From Implementation Research in the Philippines. Glob Health Sci Pract. 2023; Available from: https://www.ghspjournal.org/content/early/2023/11/09/GHSP-D-23-00202.1. [cited 2023 Nov 30]

  75. O’Brien KL, Lemango E, Nandy R, Lindstrand A. The immunization Agenda 2030: A vision of global impact, reaching all, grounded in the realities of a changing world. Vaccine. 2022; Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9754085/. [cited 2023 Nov 30]

  76. Portnoy A, Jit M, Helleringer S, Verguet S. Comparative Distributional Impact of Routine Immunization and Supplementary Immunization Activities in Delivery of Measles Vaccine in Low- and Middle-Income Countries. Value Health. 2020;23:891–7.

    Article  PubMed  PubMed Central  Google Scholar 

  77. Ryman TK, Wallace A, Mihigo R, Richards P, Schlanger K, Cappelier K, et al. Community and Health Worker Perceptions and Preferences Regarding Integration of Other Health Services With Routine Vaccinations: Four Case Studies. J Infect Dis. 2012;205:S49-55.

    Article  PubMed  Google Scholar 

  78. Ortiz JR, Perut M, Dumolard L, Wijesinghe PR, Jorgensen P, Ropero AM, et al. A global review of national influenza immunization policies: Analysis of the 2014 WHO/UNICEF Joint Reporting Form on immunization. Vaccine. 2016;34:5400–5.

    Article  PubMed  PubMed Central  Google Scholar 

  79. Kulkarni S, Harvey B, Prybylski D, Jalloh MF. Trends in classifying vaccine hesitancy reasons reported in the WHO/UNICEF Joint Reporting Form, 2014–2017: Use and comparability of the Vaccine Hesitancy Matrix. Hum Vaccines Immunother. 2021;17:2001.

    Article  CAS  Google Scholar 

  80. Pan American Health Organization. Frequent Asked Questions (FAQs): WHO-UNICEF Joint Reporting Form on Immunization (JRF) and Estimates of National Immunization Coverage (WUENIC). 2020. Available from: https://iris.paho.org/bitstream/handle/10665.2/52625/PAHOFPLIM200015_eng.pdf?sequence=1&isAllowed=y

  81. Patenaude B, Odihi D, Sriudomporn S, Mak J, Watts E, de Broucker G. A Standardized Approach for Measuring Multi-Dimensional Equity in Vaccination Coverage, Cost-of-Illness, and Health Outcomes: Evidence from the Vaccine Economics Research for Sustainability & Equity (VERSE) Project. Rochester, NY: Social Science Research Network; 2021 Oct. Report No.: ID 3945450. Available from: https://papers.ssrn.com/abstract=3945450

  82. Loughran T, Nagin DS. Finite Sample Effects in Group-Based Trajectory Models. Sociol Methods Res. 2006;35:250–78.

    Article  Google Scholar 

  83. World Health Organization. IA2030 Monitoring and Evaluation Framework. 2021. Available from: https://www.immunizationagenda2030.org/images/documents/IA2030_Annex_FrameworkForActionv04.pdf. [cited 2023 Nov 28]

Download references

Funding

This study was supported by funding from the Open Philanthropy Project and the Department of International Health at the Johns Hopkins Bloomberg School of Public Health.

Author information

Authors and Affiliations

Authors

Contributions

SJR conceptualized the study, led data collection and curation activities, analyzed the data, and was the primary drafter of this manuscript. AIVO provided methodological guidance and reviewed manuscript drafts. CMP participated in data collection and curation and reviewed manuscript drafts. MWM reviewed manuscript drafts and supervised the investigation. BNP provided methodological guidance, reviewed manuscript drafts, and supervised the investigation.

Corresponding author

Correspondence to Sanjana J. Ravi.

Ethics declarations

Competing interests

SJR received compensation from the World Health Organization (WHO) for unrelated consultation services provided during the investigation and while preparing this manuscript. WHO was neither a sponsor of nor a partner in this investigation.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ravi, S.J., Vecino-Ortiz, A.I., Potter, C.M. et al. Group-based trajectory models of integrated vaccine delivery and equity in low- and middle-income countries. Int J Equity Health 23, 5 (2024). https://doi.org/10.1186/s12939-023-02088-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12939-023-02088-x